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AMENDMENT TO THE SPECIFICATION 

Please add the following paragraphs in the specification between the second to last and 
last paragraphs. The paragraph numbers refer to the as published version of the present 
application, U.S. Patent Application Publication No. 2005/01 8655 1 : 

[0260] In one embodiment, a machine-readable storage medium includes instructions for 
assembling a sub-pool from a pool of questions where the sub-pool satisfies one or more 
constraints, in connection with creation of a standardized test comprising the sub-pool of 
questions. Such instructions, when executed by a computer, cause the computer to: form a 
candidate sub-pool by randomly selecting a plurality of questions from the pool; test the 
candidate sub-pool against the constraints; and if the constraints are satisfied, store the candidate 
sub-pool as the sub-pool. In a further embodiment, the computer is further caused to repeat the 
above steps if the constraints are not satisfied. 

[0261] In one embodiment, a machine-readable storage medium includes instructions for 
assembling a sub-pool from a pool of questions, where the sub-pool satisfies one or more 
constraints, in connection with creation of a standardized test comprising the sub-pool of 
questions. Such instructions, when executed by a computer, cause the computer to: create a 
hierarchical representation of the sub-pool, wherein the hierarchical representation comprises a 
root node and at least one other node, wherein at least one of the other nodes comprises a 
terminal node, and wherein the root node is associated with one or more root constraints and 
each of the other nodes are associated with one or more additional constraints; form a candidate 
question set comprising randomly selecting a plurality of questions from the pool; test the 
candidate question set against the additional constraints associated with the terminal node; if the 
additional constraints are satisfied, test at least the candidate question set against the root 
constraints. 

[0261] In one embodiment, a machine-readable storage medium includes instructions for 
assembling a sub-pool from a pool of questions, where the sub-pool satisfies one or more 
constraints, in connection with creation of a standardized test comprising the sub-pool of 
questions. Such instructions, when executed by a computer, cause the computer to: create a 
hierarchical representation of the sub-pool, wherein the hierarchical representation comprises a 
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root node and at least two other nodes, wherein at least two of the other nodes each comprise a 
terminal node, and wherein the root node is associated with one or more root constraints and 
each of the other nodes are associated with one or more additional constraints; form a first 
candidate question set comprising randomly selecting a plurality of questions from the pool; test 
the first candidate question set against the additional constraints associated with a first of the 
terminal nodes; form a second candidate question set comprising randomly selecting a plurality 
of questions from the pool; test the second candidate question set against the additional 
constraints associated with a second of the terminal nodes; if the first set of additional constraints 
and the second set of additional constraints are satisfied, concatenate the first candidate question 
set and the second candidate question set to form a combined question set; and test at least the 
combined set against the root constraints. In a further embodiment, the computer repeats the 
above steps if the first set of additional constraints is not satisfied. In a further embodiment, the 
computer repeats the above steps if the second set of additional constraints is not satisfied. 

[0262] In one embodiment, a machine-readable storage medium includes instructions for 
assembling a sub-pool from a pool of questions, where the sub-pool satisfies one or more 
constraints, in connection with creation of a standardized test comprising the sub-pool of 
questions. Such instructions, when executed by a computer, cause the computer to: form a 
sequence of ranges wherein each range in the sequence imposes a constraint on a scalar property 
of the sub-pool; randomly form a vector comprising a plurality of elements, wherein each of the 
elements in the vector belongs to at least one range from the sequence; and randomly select a 
plurality of questions from the pool to form the sub-pool such that each of the scalar properties 
of the sub-pool is equal to at least one of the elements of the vector. 

[0263] In one embodiment, a machine-readable storage medium includes instructions for 
assembling a sub-pool from a pool of questions, where the sub-pool satisfies one or more 
constraints, in connection with creation of a standardized test comprising the sub-pool of 
questions. Such instructions, when executed by a computer, cause the computer to: form a 
candidate sub-pool by randomly selecting a plurality of questions from the pool; determine if the 
candidate sub-pool satisfies the constraints; if the constraints are not satisfied, remove the 
questions of the candidate sub-pool from the pool of questions and repeating the above steps and 
if the constraints are satisfied, store the candidate sub-pool as the sub-pool. In a further 
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embodiment, the computer restores the pool with all of the removed questions when all of the 
questions from the pool of questions have been removed. 

[0264] In one embodiment, a machine-readable storage medium includes instructions for 
assembling a plurality of disjoint sub-pools from a pool of questions, where each sub-pool 
comprises a plurality of questions and satisfies one or more constraints, in connection with 
creation of a standardized test comprising a sub-pool of questions. Such instructions, when 
executed by a computer, cause the computer to: assemble a first collection of intersecting sub- 
pools; extract from the first collection of sub-pools a second collection of sub-pools, wherein the 
second collection of sub-pools comprises the plurality of mutually disjoint sub-pools; and store 
the second collection of sub-pools. In a further embodiment, assembling each of the sub-pools in 
the first collection comprises: forming a candidate sub-pool by randomly selecting a plurality of 
questions from the pool; testing the candidate sub-pool against the constraints; and if the 
constraints are satisfied, storing the candidate sub-pool as the sub-pool. In a further 
embodiment, the computer: computes, for each of the questions in the first collection of sub- 
pools, a frequency of usage in the first collection of sub-pools; and analyzes the questions in the 
pool of questions based on the computed frequency. 
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